Agent  Modeling 


MURI  Program  Briefing 
Washington,  DC 
August  09,  2007 


Jentsch,  F.  (2007).  Agent  Modeling.  Presentation  to  the  Office  of  Naval 
Research  Collaboration  and  Knowledge  Interoperability  Program, 
Arlington,  VA,  August  9th,  2007. 


$ 

University  of  Central  Florida 
Institute  for  Simulation  &.  Training 


I 


ILLINOIS 


M 


Arizona  State 
University 


Report  Documentation  Page 

Form  Approved 

OMB  No.  0704-0188 

Public  reporting  burden  for  the  collection  of  information  is  estimated  to  average  1  hour  per  response,  including  the  time  for  reviewing  instructions,  searching  existing  data  sources,  gathering  and 
maintaining  the  data  needed,  and  completing  and  reviewing  the  collection  of  information.  Send  comments  regarding  this  burden  estimate  or  any  other  aspect  of  this  collection  of  information, 
including  suggestions  for  reducing  this  burden,  to  Washington  Headquarters  Services,  Directorate  for  Information  Operations  and  Reports,  1215  Jefferson  Davis  Highway,  Suite  1204,  Arlington 

VA  22202-4302.  Respondents  should  be  aware  that  notwithstanding  any  other  provision  of  law,  no  person  shall  be  subject  to  a  penalty  for  failing  to  comply  with  a  collection  of  information  if  it 
does  not  display  a  currently  valid  OMB  control  number. 

1.  REPORT  DATE 

2007 

2.  REPORT  TYPE 

N/A 

3.  DATES  COVERED 

4.  TITLE  AND  SUBTITLE 

Agent  Modeling 

5a.  CONTRACT  NUMBER 

5b.  GRANT  NUMBER 

5c.  PROGRAM  ELEMENT  NUMBER 

6.  AUTHOR(S) 

5d.  PROJECT  NUMBER 

5e.  TASK  NUMBER 

5f.  WORK  UNIT  NUMBER 

7.  PERFORMING  ORGANIZATION  NAME(S)  AND  ADDRESS(ES) 

University  of  Central  Florida 

8.  PERFORMING  ORGANIZATION 

REPORT  NUMBER 

9.  SPONSORING/MONITORING  AGENCY  NAME(S)  AND  ADDRESS (ES) 

10.  SPONSOR/MONITOR’S  ACRONYM(S) 

11.  SPONSOR/MONITOR’S  REPORT 
NUMBER(S) 

12.  DISTRIBUTION/AVAILABILITY  STATEMENT 

Approved  for  public  release,  distribution  unlimited 

13.  SUPPLEMENTARY  NOTES 

The  original  document  contains  color  images. 

14.  ABSTRACT 

15.  SUBJECT  TERMS 

16.  SECURITY  CLASSIFICATION  OF: 

17.  LIMITATION  OF 
ABSTRACT 

uu 

18.  NUMBER 
OF  PAGES 

20 

19a.  NAME  OF 
RESPONSIBLE  PERSON 

a.  REPORT 

unclassified 

b.  ABSTRACT 

unclassified 

c.  THIS  PAGE 

unclassified 

Standard  Form  298  (Rev.  8-98) 

Prescribed  by  ANSI  Std  Z39-18 


Sometime  its  just  better  to  sleep  through  it  ell 


Agent  Modeling  Team 


□  Lead  Scientist: 

■  Florian  Jentsch,  Ph.D. 
(UCF) 

□  Primary  Scientists: 

■  Michael  Lewis,  Ph.D. 

■  Denise  Nicholson,  Ph.D. 

■  Randall  Shumaker,  Ph.D. 
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Overview 


□  Roles  of  Agents  in  Teams 

□  Research  Issues: 


■  Primary  Research 

■  Enabling  Objectives  and  Technologies 

□  Approach: 

■  Practical  Problems 

■  Tasks  &  Linkages 

□  Year  1: 

■  Mapping  the  Roles  of  Intelligent  Agents 
against  the  CKI  Framework 
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Agent  Modeling:  Background  &  Motivation 

□  Desired  Outcomes 

■  Develop  models  &  techniques  for  facilitating 
interactions  for  human-agent  teams 

□  Control  of  agent  teams 

□  Many-human/many  agent  teams 

■  Develop  models  &  techniques  for  emulating 
human  performance 

□  From  literature 

□  From  archival  data 

□  Online  adaptation  to  emulate  human  teammates 
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One-Of-A-Kind  Teams  In  One-Of-A-Kind  Situations 
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Roles  of  Agents  in  Teams 

□  Agents  can  act  in  teams  as: 

■  Taskwork-functional  components: 

□  Collecting/storing/processing/retrieval  of  task  data 

□  Representation  of  task  data 

■  Teamwork-functional  components: 

□  Process  assessment 

□  Dynamic  function  allocation 

□  Team  "metacognition"  and  coaching 

■  Surrogate  team  members: 

□  Training 

□  Research 

■  External  observers: 

Data  collection  for  research  and  training 
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Research  Issues 

□  Primary  questions,  in  order  of  precedence: 

■  Agents  as  teamwork-functional  components 

■  Agents  as  external  observers 

■  Agents  as  surrogate  team  members 

□  6.1  nature  of  the  work: 

■  Study  wide  range  of  potential  variables  to  model 

■  As  generalizable  across  task  areas,  team  sizes,  team 
structures  as  possible 

□  Enabling  objectives  and  technologies: 

■  Identify  and  collect  critical  data 

■  Select  simulation  environment  and  methods 

■  Match  computational  load  to  capabilities 
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Approach:  Practical  Problems 

□  Constraints  to  "Realism": 

■  Open-ended  vs.  scripted  scenarios 

■  Complexity  of  team  member  signatures 

■  Embodied  agents 

■  Communication  modes 

■  Behavioral  outputs 

■  Modeling  environment 

■  "One-of-a-kind"  situations 
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Approach:  Tasks  &  Linkages 


□  Collect  data  to  model 

■  Theory,  metrics,  experimentation 

□  Analyze  modeling  data 

■  Metrics 

□  Create  initial  teammate  emulation 

■  Theory 

□  Cross- validate  model  against  archival  data 

■  Metrics 

□  Conduct  single  and  "double"  Turing  test  & 
identify  human/agent  differences 
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Year  1:  Mapping  the  Roles  of 
Intelligent  Agents  against  the 
CKI  Framework 
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Agents  in  Macrocognition 


□  Externalized  cognition  allows  agents  to 
become  first  class  participants  by  doing 
things  such  as: 

■  Identifying  targets 

■  Filtering  information 

■  Communicating  messages 

■  ...  just  like  human  participants 


□  Difficulties  exist  for  processes  such  as  problem 
conceptualization  or  sense  making  that  require 
nonstationarity 
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Agents  in  Knowledge  Building 

s  Pattern  recognition 

•s  ATR  and  other  sensor-driven  recognition 

s  Situation  classification;  example:  machine 
learning  for  rating  credit  worthiness 

?  Mental  model  construction 

s  Yes,  if  involves  match  to  stored  models 

*  No  (or  extremely  difficult)  if  requires 
discovery/reorganization 
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Agents  in  Team  Knowledge  Building 

s  Knowledge  sharing  involving  deictic 
pointing 

s  Spatial/geographic  references  on  shared  map 
or  screen 

s  Sequence  or  temporal  ordering  through 
timeline 

?  Knowledge  sharing  requiring  NLP 

✓  Key  words  to  index  stored  plans/contexts 
x  "Understand"  team  dialog  &  discussions 
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Agents  in  Sharing  Unique  Knowledge 

s  Eliciting  knowledge  from  teammates 

s  Queries  for  empty  slots 

□  Communicating  own  knowledge 

■  Text/speech  tend  to  be  too  explicit/extensive 

■  Graphical  expression  such  as  marked-up  map 
deliver  information  in  parallel 

s  Identify  things  to  point  out/share  (recognize  expertise) 

s  Overlay  models  to  id  potentially  missing 
information  from  group  decisions  (critiquing) 


* 

hr  HhMtn  h  mdflirtg 


ILLINOIS 

i/ntoT’  t  Jr 


Aresm  State 
University 


Agents  in  Shared  Conceptualization 

s  Visualization  of  data 

•s  Automated  choice  &  generation  of  visual 
representation  (such  as  SAGE  or  APT) 

?  Team  problem  model/common  ground 

x  Difficult  for  agent  unless  team  shares  its 
model 

✓  Graphical/map  based  model  could  be  shared 
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Agents  in  Consensus  Development 


□  Can  agents  vote?  Do  we  want  them  to 
negotiate? 

v'  Option  generation 

s  Agent  with  HTN  planner  could  propose  &  or 
critique  plans  if  expressed  in  accessible  form 


x  Intuitive  decisions,  critical  thinking 
?  Storyboard ing 

✓  Maybe  if  using  agent  generated  or  accessible 
graphics 
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Agents  in  Outcome  Appraisal 

✓  Maintain  performance  logs  and  other 
records  of  problem  solving  episode  for 
AAR 

x  Workspace  awareness,  activity 
awareness,  etc. 
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Summary:  The  Way  Ahead 

□  Integrating  agents  into  a  macrocog nitive 
process  requires  a  common  (external) 
representation  they  can  access 

□  Agent-generated  or  -accessible  graphical 
displays  of  maps,  timelines,  etc.  seem  the 
most  natural  way  to  achieve  this 

□  The  Macro-Cog  discrete  event  simulation 
appears  to  allow  sufficient  access  to  state 
variables  for  agents  to  be  situation  aware 
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Take  time  to  smell  the  flowers, 
men  eat  them. 

Then  puke  them  up  on  the  carpet. 
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